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DETAILED ACTION 

This communication is responsive to amendments filed 02/08/201 1 . Claims 4, 6, 
7 and 15 have been amended. Claims 4, 6-7, 12-13 and 15-22 are currently pending. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary sl<ill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 4, 6, 7, 15 and 18-22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rafii et al. (6,614,422) in view of Fong et al. (US 2005/0012721) and 
further in view of Kloba (US 7,263,547) and Tanguay Jr. et al. (2006/0092178). 

In reference to claim 4, Rafii teaches a mobile communication terminal (Rafii, Fig. 
1A, 80), comprising: 

image projection means for projecting a selected one of a plurality of predefined 
operation-plane images that displays virtually an operation-plane of an operation device 
operated by users (Rafii, Fig. 1A, 145; col. 4, II. 27-33); 

operation detection means for detecting operation on the selected operation- 
plane image projected by the image projection means (Rafii, Fig. 1A, 20; col. 10, II. 27- 
34); 
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data processing means for performing a predetermined data process based on 
the detection result of operation detected by tfie operation detection means (Rafii, Fig. 
3; col. 7, II. 16-18); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
designated recognition function corresponding to the selected predefined operation- 
plane image (Rafii, Fig. 1A,145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

wherein the image projection means projects the selected predefined operation- 
plane image corresponding to the designated recognition function designated by the 
designation information received from the application execution management means, 
from among the plurality of predefined operation-plane images (Rafii, col. 4, II. 27-33; 
projection of a grid or image); 

and wherein the operation detection means has a plurality of kinds of mutually 
different recognition functions to recognize operation content by at least one of position, 
direction and movement of an operation object on the plurality of predefined operation- 
plane images (Rafii, col. 12, II. 33-47), 

and detects operation on the selected operation-plane image by using the 
designated recognition function designated from among the plurality of mutually 
different recognition functions by the designation information received from the 
application execution management means (Rafii, col. 10, II. 27-34). 
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Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network. 

Kloba discloses a system for customizing content on a mobile device, analogous 
in art with that of Rafii as modified by Fong, containing application execution 
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management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41 ; col. 7, II. 5-9; col. 1 1 , II. 1 5- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 
program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1, II. 36-39). 

Rafii as modified by Fong and Kloba however fails to expressly teach wherein at 
least one of the plurality of mutually different recognition functions is a handwriting input 
function that detects movements of the operation object corresponding to a handwriting 
motion of a user, and wherein, for the designated recognition function being the 
handwritten input recognition function, the at least part of the selected operation-plane 
image is changed in a manner that tracks the handwriting motion. 

Tanguay discloses a projected virtual input writing and display device, analogous 
in art with that of Rafii as modified by Fong and Kloba, wherein at least one of the 
plurality of mutually different recognition functions is a handwriting input function that 
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detects movements of the operation object corresponding to a handwriting motion of a 
user, and wherein, for the designated recognition function being the handwritten input 
recognition function, the at least part of the selected operation-plane image is changed 
in a manner that tracks the handwriting motion (Tanguay, Fig. 2; pg. 5, par. 55; pg. 6, 
par. 57; pg. 10-11, par. 103-104). 

At the time the Invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the recognition function of Rafii as modified by Fong 
and Kloba wherein at least one of the plurality of mutually different recognition functions 
is a handwriting input function that detects movements of the operation object 
corresponding to a handwriting motion of a user, and wherein, for the designated 
recognition function being the handwritten input recognition function, the at least part of 
the selected operation-plane image is changed in a manner that tracks the handwriting 
motion, as taught by Tanguay. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been allow users to display their input in a shared virtual model 
(Tanguay, pg. 2, par. 55). 

In reference to claim 6, Rafii teaches a mobile communication terminal (Rafii, Fig. 
1A, 80), comprising: 

image projection means for projecting a selected one of a plurality of predefined 
operation-plane images that displays virtually an operation-plane of an operation device 
operated by users (Rafii, Fig. 1A, 145; col. 4, II. 27-33); 
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operation detection means for detecting operation on tine selected operation- 
plane image projected by the image projection means (Rafii, Fig. 1A, 20; col. 10, II. 27- 
34); 

data processing means for performing a predetermined data process based on 
the detection result of operation detected by the operation detection means (Fig. 3; col. 
7, II. 16-18); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
recognition function corresponding to the selected predefined operation-plane image 
(Rafii, Fig. 1A,145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

wherein the image projection means projects the selected predefined operation- 
plane image corresponding to the designated recognition function designated by the 
designation information received from an application execution management means, 
from among the plurality of predefined operation-plane images (Rafii, col. 4, II. 27-33; 
projection of a grid or image); 

and wherein the operation detection means has a plurality of kinds of mutually 
different recognition functions to recognize operation content by at least one of position, 
direction and movement of an operation object on the plurality of predefined operation- 
plane images (Rafii, col. 12, II. 33-47), 

and detects operation on the selected operation-plane image by using the 
designated recognition function corresponding to the selected operation-plane image. 
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the designated recognition function being designated from among the plurality of 
mutually different recognition functions by the designation information received from the 
application execution management means (Rafii, col. 10, 1. 27-34). 

Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
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application program selected from a plurality of application programs that is downloaded 
via a mobile communication network. 

Kloba discloses a system for customizing content on a mobile device, analogous 
in art with that of Rafii as modified by Fong, containing application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41 ; col. 7, II. 5-9; col. 1 1 , II. 1 5- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 
program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1 , II. 36-39). 

Rafii as modified by Fong and Kloba however fails to expressly teach wherein at 
least one of the plurality of mutually different recognition functions is a handwriting input 
function that detects movements of the operation object corresponding to a handwriting 
motion of a user, and wherein, for the designated recognition function being the 
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handwritten input recognition function, the at least part of the selected operation-plane 
image is changed in a manner that tracks the handwriting motion. 

Tanguay discloses a projected virtual input writing and display device, analogous 
in art with that of Rafii as modified by Fong and Kloba, wherein at least one of the 
plurality of mutually different recognition functions is a handwriting input function that 
detects movements of the operation object corresponding to a handwriting motion of a 
user, and wherein, for the designated recognition function being the handwritten input 
recognition function, the at least part of the selected operation-plane image is changed 
in a manner that tracks the handwriting motion (Tanguay, Fig. 2; pg. 5, par. 55; pg. 6, 
par. 57; pg. 10-11, par. 103-104). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the recognition function of Rafii as modified by Fong 
and Kloba wherein at least one of the plurality of mutually different recognition functions 
is a handwriting input function that detects movements of the operation object 
corresponding to a handwriting motion of a user, and wherein, for the designated 
recognition function being the handwritten input recognition function, the at least part of 
the selected operation-plane image is changed in a manner that tracks the handwriting 
motion, as taught by Tanguay. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been allow users to display their input in a shared virtual model 
(Tanguay, pg. 2, par. 55). 
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In reference to claim 7, Rafii teaches a mobile communication terminal (Rafil Fig. 
1A, 80), comprising: 

image projection means for projecting a selected one of a plurality of predefined 
operation-plane image that displays virtually an operation-plane of an operation device 
operated by users (Rafii, Fig. 1A, 145; col. 4, II. 27-33); 

operation detection means for detecting operation on the operation-plane image 
projected by the image projection means (Rafii, Fig. 1 A, 20; col. 10, II. 27-34); 

data processing means for performing a predetermined data process based on 
the detection result of operation detected by the operation detection means (Fig. 3; col. 
7, II. 16-18); 

memory means for storing a plurality of image data corresponding to each one of 
the plurality of predefined operation-plane images (Rafii, col. 12, II. 48-53); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
recognition function corresponding to the selected predefined operation-plane image 
(Rafii, Fig. 1A,145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

and instruction generation means for generating an operation-plane image 
selection instruction in accordance with the content of the selected application program 
(Fig. 3; col. 7, II. 16-18); 

wherein the image projection means selects an image data from the plurality of 
image data memorized in the memory based on the operation-plane image selection 
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instruction generated by the instruction generation means, and projects tine operation- 
plane image of the selected image data (Rafii, col. 4, II. 27-33; projection of a grid or 
image); 

and wherein the application execution management means performs a data 
process corresponding to operation detected by the operation detection means in 
accordance with the content of the application program dunng execution of the selected 
application program and in accordance with the designation information that designates 
the designated recognition function (Rafii, col. 10, II. 27-34). 

Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 
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As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that Is downloaded 
via a mobile communication network. 

Kloba discloses a system for customizing content on a mobile device, analogous 
In art with that of Rafll as modified by Fong, containing application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41 ; col. 7, II. 5-9; col. 1 1 , II. 15- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 

program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1, II. 36-39). 
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Rafii as modified by Fong and Kloba however fails to expressly teacii wlierein at 
least one of the plurality of mutually different recognition functions is a handwriting input 
function that detects movements of the operation object corresponding to a handwriting 
motion of a user, and wherein, for the designated recognition function being the 
handwritten input recognition function, the at least part of the selected operation-plane 
image is changed in a manner that tracks the handwriting motion. 

Tanguay discloses a projected virtual input writing and display device, analogous 
in art with that of Rafii as modified by Fong and Kloba, wherein at least one of the 
plurality of mutually different recognition functions is a handwriting input function that 
detects movements of the operation object corresponding to a handwriting motion of a 
user, and wherein, for the designated recognition function being the handwritten input 
recognition function, the at least part of the selected operation-plane image is changed 
in a manner that tracks the handwriting motion (Tanguay, Fig. 2; pg. 5, par. 55; pg. 6, 
par. 57; pg. 10-11, par. 103-104). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the recognition function of Rafii as modified by Fong 
and Kloba wherein at least one of the plurality of mutually different recognition functions 
is a handwriting input function that detects movements of the operation object 
corresponding to a handwriting motion of a user, and wherein, for the designated 
recognition function being the handwritten input recognition function, the at least part of 
the selected operation-plane image is changed in a manner that tracks the handwriting 
motion, as taught by Tanguay. 
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As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been allow users to display their input in a shared virtual model 
(Tanguay, pg. 2, par. 55). 

In reference to claim 15, Rafii teaches a mobile communication terminal (Rafii, 
Fig. 1A, 80), comprising: 

an image projector that projects a selected one of a plurality of predefined 
operation-plane images that displays virtually an operation-plane of an operation device 
(Rafii, Fig. 1A, 145; col. 4, II. 27-33); 

an operation detector that detects operation on the selected operation-plane 
image projected by the image projector (Rafii, Fig. 1 A, 20; col. 10, II. 27-34); 

a data processor that performs a predetermined data process based on the 
detection result of operation detected by the operation detector (Rafii, Fig. 3; col. 7, II. 
16-18); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
designated recognition function corresponding to the selected predefined operation- 
plane image (Rafii, Fig. 1A,145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

wherein the image projector projects the selected operation-plane image 
corresponding to the designated recognition function designated by the designation 
information received from an application execution management device, from among 
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the plurality of predefined operation-plane images (Rafii, col. 4, II. 27-33; projection of a 
grid or image); 

and wherein the operation detector has a plurality of kinds of mutually different 
recognition functions to recognize operation content by at least one of position, direction 
and movement of an operation object on the plurality of predefined operation-plane 
images (Rafii, col. 12, II. 33-47), 

and detects operation on the selected operation-plane image by using the 
designated recognition function designated from among the plurality of kinds of mutually 
different recognition functions by the designation information received from the 
application execution management device (Rafii, col. 10, II. 27-34). 

Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
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on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network. 

Kloba discloses a system for customizing content on a mobile device, analogous 
in art with that of Rafii as modified by Fong, containing application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41 ; col. 7, II. 5-9; col. 1 1 , II. 15- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 
program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 
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As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1, II. 36-39). 

Rafii as modified by Fong and Kloba however fails to expressly teach wherein at 
least one of the plurality of mutually different recognition functions is a handwriting input 
function that detects movements of the operation object corresponding to a handwriting 
motion of a user, and wherein, for the designated recognition function being the 
handwritten input recognition function, the at least part of the selected operation-plane 
image is changed in a manner that tracks the handwriting motion. 

Tanguay discloses a projected virtual input writing and display device, analogous 
in art with that of Rafii as modified by Fong and Kloba, wherein at least one of the 
plurality of mutually different recognition functions is a handwriting input function that 
detects movements of the operation object corresponding to a handwriting motion of a 
user, and wherein, for the designated recognition function being the handwritten input 
recognition function, the at least part of the selected operation-plane image is changed 
in a manner that tracks the handwriting motion (Tanguay, Fig. 2; pg. 5, par. 55; pg. 6, 
par. 57; pg. 10-11, par. 103-104). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the recognition function of Rafii as modified by Fong 
and Kloba wherein at least one of the plurality of mutually different recognition functions 
is a handwriting input function that detects movements of the operation object 
corresponding to a handwriting motion of a user, and wherein, for the designated 
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recognition function being tine liandwritten input recognition function, the at least part of 
the selected operation-plane image is changed in a manner that tracks the handwriting 
motion, as taught by Tanguay. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been allow users to display their input in a shared virtual model 
(Tanguay, pg. 2, par. 55). 

Claim 18 is rejected as being dependent on rejected claim 15 as discussed 
above and further, Rafii as modified by Fong, Kloba and Tanguay teaches further 
comprising: a memory that stores the plurality of predefined operating-plane images 
(Rafii, col. 12, II. 48-53). 

Claim 19 is rejected as being dependent on rejected claim 4 as discussed above 
and further, Rafii as modified by Fong, Kloba and Tanguay teaches wherein changing 
the part of the selected operation-plane image includes at least one of: changing a color 
of the part of the selected operation plane image, changing a luminance of the part of 
the selected operation-plane image, and changing the part of the selected operation- 
plane image into a different image (Fong, fig. 3; pg. 2, par. 19). 

Claim 20 is rejected as being dependent on rejected claim 6 as discussed above 
and further, Rafii as modified by Fong, Kloba and Tanguay teaches wherein changing 
the part of the selected operation-plane image includes at least one of: changing a color 
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of the part of the selected operation plane image, changing a luminance of the part of 
the selected operation-plane image, and changing the part of the selected operation- 
plane image into a different image (Fong, fig. 3; pg. 2, par. 19). 

Claim 21 is rejected as being dependent on rejected claim 7 as discussed above 
and further, Rafii as modified by Fong, Kloba and Tanguay teaches wherein changing 
the part of the selected operation-plane image includes at least one of: changing a color 
of the part of the selected operation plane image, changing a luminance of the part of 
the selected operation-plane image, and changing the part of the selected operation- 
plane image into a different image (Fong, fig. 3; pg. 2, par. 19). 

Claim 22 is rejected as being dependent on rejected claim 15 as discussed 
above and further, Rafii as modified by Fong, Kloba and Tanguay teaches wherein 
changing the part of the selected operation-plane image includes at least one of: 
changing a color of the part of the selected operation plane image, changing a 
luminance of the part of the selected operation-plane image, and changing the part of 
the selected operation-plane image into a different image (Fong, fig. 3; pg. 2, par. 19). 

Claims 12, 13, 16 and 17 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rafii et al. (6,614,422) as modified by Fong et al. (US 
2005/0012721), Kloba (US 7,263, 547) and Tanguay Jr. et al. (US 2006/0092178), and 
further in view of Lieberman (US 2002/0075240). 
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Claim 12 is rejected as being dependent on claims 4, 6, or 7 as discussed above 
and further, Rafii as modified by Fong, Kloba and Tanguay however fails to expressly 
teach a mobile communication terminal wherein the mobile communication terminal is 
configured by using a light source, a spatial light modulation unit for modulating light 
output from the light source, and an optical system for projection imaging that projects 
by imaging a light image output from the spatial light modulation unit on an external 
projection screen, the mobile communication terminal comprises an optical system for 
diffused illumination for homogenously illuminating by diffusing light output from the light 
source to an external illumination plane, and the light source and the spatial light 
modulation unit are both shared to generate a light image subject to projection and 
generate a light subject to diffused illumination. 

Lieberman discloses a virtual data entry device, analogous in art with that of Rafii 
as modified by Fong, Kloba and Tanguay, wherein the mobile communication terminal 
is configured by using a light source, a spatial light modulation unit for modulating light 
output from the light source, and an optical system for projection imaging that projects 
by imaging a light image output from the spatial light modulation unit (Lieberman, Fig. 
28; pg. 10, par. 184) on an external projection screen (Lieberman, Fig. 29; pg. 10, par. 
186), 

the mobile communication terminal comprises an optical system for diffused 
illumination (Lieberman, pg. 10, par. 184) for homogenously illuminating by diffusing 
light output from the light source to an external illumination plane (Lieberman, Fig. 28), 
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and the light source and the spatial light modulation unit are both shared to 
generate a light image subject to projection and generate a light subject to diffused 
illumination (Lieberman, pg. 6, par. 135; light source is a single laser source). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong, Kloba and Tanguay wherein the mobile communication terminal is configured 
by using a light source, a spatial light modulation unit for modulating light output from 
the light source, and an optical system for projection imaging that projects by imaging a 
light image output from the spatial light modulation unit on an external projection screen, 
the mobile communication terminal comprises an optical system for diffused illumination 
for homogenously illuminating by diffusing light output from the light source to an 
external illumination plane and the light source and the spatial light modulation unit are 
both shared to generate a light image subject to projection and generate a light subject 
to diffused illumination, as taught by Lieberman. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide an expanded input device for a small sized PDA or 
cell phone (Lieberman, pg. 1 , par. 9). 

Claim 13 is rejected as being dependent on rejected claim 12 as discussed 
above and further Rafii as modified by Fong, Kloba, Tanguay and Lieberman teaches a 
mobile communication terminal, the mobile communication terminal comprising (Rafii, 
Fig. 1A, 80): 
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a camera unit tliat generates image data by transforming the liglit image to 
electric signals (Rafii, col. 2, II. 21-36); 

and an optical system for camera imaging for imaging the light image subject to 
shooting on the camera unit (Rafii, col. 2, II. 21-57); 

wherein the operation detection means is configured by using operation object 
detection means for detecting at least one of position, direction, and movement of an 
operation object operating on the operation-plane image and operation detection data 
generation means for generating operation detection data corresponding to position, 
direction or movement of the operation object based on the detection results of the 
operation detection means (Rafii, col. 2, II. 21-57); 

and the camera unit and the optical system for camera imaging are both shared 
as the operation object detection means (Rafii, col. 2, II. 21-57). 

Claim 16 is rejected as being dependent on rejected claim 15 as discussed 
above and further Rafii as modified by Fong, Kloba and Tanguay however fails to 
expressly teach a mobile communication terminal wherein the mobile communication 
terminal is configured by using a light source, a spatial light modulation unit for 
modulating light output from the light source, and an optical system for projection 
imaging that projects by imaging a light image output from the spatial light modulation 
unit on an external projection screen, the mobile communication terminal comprises an 
optical system for diffused illumination for homogenously illuminating by diffusing light 
output from the light source to an external illumination plane, and the light source and 
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the spatial liglit modulation unit are both shared to generate a light image subject to 
projection and generate a light subject to diffused illumination. 

Lieberman discloses a virtual data entry device, analogous in art with that of Rafii 
as modified by Fong, Kloba and Tanguay, wherein the mobile communication terminal 
is configured by using a light source, a spatial light modulation unit for modulating light 
output from the light source, and an optical system for projection imaging that projects 
by imaging a light image output from the spatial light modulation unit (Lieberman, Fig. 
28; pg. 10, par. 184) on an external projection screen (Lieberman, Fig. 29; pg. 10, par. 
186), 

wherein the mobile communication terminal comprises an optical system for 
diffused illumination (Lieberman, pg. 10, par. 184) for homogenously illuminating by 
diffusing light output from the light source to an external illumination plane (Lieberman, 
Fig. 28), 

and wherein the light source and the spatial light modulation unit are both shared 
to generate a light image subject to projection and generate a light subject to diffused 
illumination (Lieberman, pg. 6, par. 135; light source is a single laser source). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong, Kloba and Tanguay wherein the mobile communication terminal is configured 
by using a light source, a spatial light modulation unit for modulating light output from 
the light source, and an optical system for projection imaging that projects by imaging a 
light image output from the spatial light modulation unit on an external projection screen. 
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wherein the mobile communication terminal comprises an optical system for diffused 
illumination for homogenously illuminating by diffusing light output from the light source 
to an external illumination plane and wherein the light source and the spatial light 
modulation unit are both shared to generate a light image subject to projection and 
generate a light subject to diffused illumination, as taught by Lieberman. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide an expanded input device for a small sized PDA or 
cell phone (Lieberman, pg. 1 , par. 9). 

Claim 17 is rejected as being dependent on rejected claim 16 as discussed 
above and further Rafii as modified by Fong, Kloba, Tanguay and Lieberman teaches a 
mobile communication terminal, the mobile communication terminal comprising (Rafii, 
Fig. 1A, 80): 

a camera unit that generates image data by transforming the light image to 
electric signals (Rafii, col. 2, II. 21-36); 

and an optical system for camera imaging for imaging the light image subject to 
shooting on the camera unit (Rafii, col. 2, II. 21-57); 

wherein the operation detector is configured by using an operation object 
detector that detects at least one of position, direction, and movement of an operation 
object operating on the operation-plane image and operation detection data generator 
that generates operation detection data corresponding to position, direction or 



Application/Control Number: 1 0/586,31 9 Page 26 

Art Unit: 2629 

movement of the operation object based on the detection results of the operation object 
detector (Rafii, col. 2, II. 21-57); 

and the camera unit and the optical system for camera imaging are both shared 
as the operation object detector (Rafii, col. 2, II. 21-57). 

Response to Arguments 

Applicant's arguments with respect to claims 4, 6-7, 12-13 and 15-22 have been 
considered but are moot in view of the new ground(s) of rejection. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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Any inquiry concerning tliis communication or earlier communications from the 
examiner should be directed to CHARLES HICKS whose telephone number is 571-270- 
7535. The examiner can normally be reached on Monday-Thursday from 7:30 to 4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Alexander Beck, can be reached on 571-272-7765. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://portal.uspto.gov/external/portal. 
Should you have questions on access to the Private PAIR system, contact the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

CH /Alexander S. Beck/ 

Supervisory Patent Examiner, Art Unit 2629 



